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FIELD OF THE INVENTION 
The present invention relates to an image storage 
method and apparatus in an image database used to search 
a plurality of images for a desired one. 



Many image databases have been proposed to search 
a large number of image data for a desired image. Most 
of these databases are roughly categorized into two 
methods : 

•a method of relating non-image information such as - 
a keyword, photographing date, and the like to images, 
and making a search based on such information; and 

•a method of making a search based on feature 
amounts (luminance, color difference information, image 
frequency, histogram, and the like) of images themselves. 

In either methods, query information and image 
data are normally managed separately. For example, 
query data are managed using a single file or relational 
database and actually undergo a search. File names of 
image data that match the query condition are obtained 
from the search results, and image data are accessed and 
displayed based on these file names. The reason why 
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such method is used is that image data normally has a 
large size and it is efficient to manage such image data 
independently from query data. 

Individual image data are managed in a file system, 
5 and two management methods are available. The first 

method manages all image data using a single directory. 
The second method divides image data into some groups 
each including a plurality of images, and classifies and 
manages image data in directories in units of groups. 

10 For example, image data may be classified in 

directories based on their contents such as "animals" , 
"flowers", and the like. 

However, in both the first and second methods, 
when a plurality of images obtained as a result of a 

15 search using a query key or the like are to be displayed 
at the same time, if the number of images is large, 
image access requires a very long period of time. 

In the first method, it is easy to manage images. 
However, if the number of images is too large, a very 

2 0 long time is required to acquire only directory 

information. In the second method, correspondence 
between image files and directories must be correctly 
maintained, and management such as file movement or the 
like is troublesome. 

2 5 The present inventors previously proposed a 

technique for storing a plurality of images and their 
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feature amount data in a single file in, e.g., U.S. Appl . 
No. 09/3 84,965. This technique can search for an image 
with highest similarity on the basis of the feature 
amounts of an image as query keys and a plurality of 
5 images as test images, and can display an image as a 
search result at high speed. 

However, in the above proposal, the data size of 
an image file becomes very large with increasing number 
of images included in the image file. To solve this 
■?!? 10 problem, individual image data included in the image 

j!^ file must have a relatively low resolution. As a result, 

H even when such image is output to a high-resolution 

SO printer, it becomes difficult to obtain a high-quality 

O image output . 

p!J 15 

O SUMMARY OF THE INVENTION 

The present invention has been made in 
consideration of the aforementioned problems, and has as 
its object to allow high-speed access to image data and 
2 0 easy management of image data by storing a plurality of 
image data in a single file, and to offer various 
services by allowing to acquire information that 
pertains to each image data from a source outside the 
image file. 
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For example, as the information that pertains to 
image data, image data with higher resolution is 
specified, thus obtaining a high-quality image output. 

In order to achieve the above object, an image 
5 storage method according to the present invention 
comprises, e.g., the following steps. 

That is, an image storage method comprises: 

the image storage step of continuously storing a 
plurality of image data in a first area of a single 
10 file; and 

the reference information storage step of storing 
reference information to a source outside the file, 
which pertains to each of the plurality of image data 
stored in the image storage step, in a storage order of 
15 the plurality of image data in a second area of the file 

Also, according to the present invention, an image 
storage apparatus that implements the image storage 
method is provided. Furthermore, according to the 
present invention, a storage medium that stores a file 
2 0 generated by the image storage method, and a storage 
medium that stores a control program for making a 
computer implement the image storage method are provided 

It is another object of the present invention to 
provide an image storage apparatus, storage medium, and 
2 5 control program, which allow easy handling of an image 
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file, and allow the user to use an image with high image 
quality. 

It is still another object of the present 
invention to provide a novel function. 
5 Other features and advantages of the present 

invention will be apparent from the following description 
taken in conjunction with the accompanying drawings, in 
which like reference characters designate the same or 
Q similar parts throughout the figures thereof. 

m 10 

2 BRIEF DESCRIPTION OF THE DRAWINGS 

L: Fig. 1 is a block diagram showing the arrangement 

"* ;s of a computer system as an image storage apparatus 

^ according to an embodiment of the present invention; 

15 Fig. 2 shows a schematic format of an image file 

C3 created by an image storage method according to the 

first embodiment of the present invention; 

Fig. 3 shows details of the data configuration of 
an image information area 201 shown in Fig. 2; 
20 Fig. 4 shows details of the data configuration in 

a feature amount data area 203 shown in Fig. 2; 

Fig. 5 shows details of the data configuration in 
an image data area 2 02 shown in Fig. 2; 

Fig. 6 shows details of the data configuration in 
25 an index area 2 04 shown in Fig. 2; 
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Fig. 7 is a flow chart showing an outline of an 
image file generation process in the first embodiment; 

Fig. 8 is a flow chart for explaining a header 
data write process in step S601 shown in Fig. 7 in 
5 detail; 

Fig. 9 is a flow chart for explaining a detailed 
sequence of a process in step S602 in Fig. 7; 

Fig. 10 is a view showing screen division upon 
tj computing a feature amount in the first embodiment ; 

Ofl 10 Fig. 11 is a flow chart for explaining a feature 

gn amount computation process in the first embodiment; 

kj Fig. 12 is a flow chart for explaining an average 

7" value computation method of R, G, and B values in units 

^ of regions; 

15 Fig. 13 is a flow chart for explaining a reference 

y information (index data) storage process in step S807 in 

Fig. 9 in detail; 

Fig. 14 is a flow chart for explaining a data 
write process in the feature amount area and index area 
20 in step S603 in Fig. 7; and 

Fig. 15 is a flow chart for explaining an image 
information additional write process in step S604 in 
Fig. 7. 

2 5 DESCRIPTION OF THE PREFERRED EMBODIMENTS 



- 6 - 



A preferred embodiment of the present invention 
will be described hereinafter with reference to the 
accompanying drawings . 
[First Embodiment] 
5 Fig. 1 is a block diagram showing the arrangement 

of a computer system as an image storage apparatus 
according to this embodiment. Referring to Fig. 1, 
reference numeral 101 denotes a CPU which controls the 
Q overall system. Reference numeral 102 denotes a 

Hn 10 keyboard which is used to make operation inputs to the 

00 system together with a mouse 102a. Reference numeral 

y\ 103 denotes a display unit which comprises a CRT, liquid 

2" crystal display, or the like. Reference numeral 104 

denotes a ROM; and 105, a RAM, which forms a storage 
15 device of the system and stores programs to be executed 
by the system, and data used by the system. Reference 
numeral 106 denotes a hard disk device; and 107, a 
floppy disk device, which constructs an external storage 
device used by a file system of the system. Reference 
20 numeral 108 denotes a printer, which forms a visible 

image on a recording medium on the basis of image data. 

Note that processes such as creation of an image 
file and the like to be described below are implemented 
when the CPU 101 executes control programs stored in the 
25 ROM 104 or RAM 105. Also, an image file formed in the 
following description is finally stored in the external 
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storage device such as the hard disk 106, floppy disk 
107, or the like. 

Fig. 2 shows a schematic format of an image file 
created by an image storage method according to the 
5 first embodiment. Referring to Fig. 2, reference 
numeral 2 01 denotes an image information area (also 
referred to as a header area) , which stores information 
required for reading out and displaying images, such as 
the number of images, a compression scheme, the numbers 

10 of vertical and horizontal pixels of individual images, 
feature amount extraction methods of individual images, 
and the like. Reference numeral 202 denotes an image 
data area which continuously stores all image data to be 
stored as the image file. Reference numeral 2 03 denotes 

15 a feature amount data area which continuously stores 

feature amounts (luminance, color difference information, 
image frequency, histogram, and the like) of a plurality 
of images stored in the image data area 202. Reference 
numeral 2 04 denotes an index area which continuously 

20 records reference information to associated information 
of each of all image data stored in the image data area 
202 . 

Fig. 3 shows details of the data configuration of 
the image information area 201 shown in Fig. 2. In this 
2 5 example, 4-byte fields are assured in this area, but the 
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field size can be changed in correspondence with the 
number or sizes of images to be stored. 

A field 301 stores "Version" indicating the 
revision number of this image format. A field 302 
5 stores "Images" indicating the total number of recorded 
images. A field 303 stores "Mode" indicating values 
used as image feature amounts. A value "0" is set in 
"Mode" when the image feature amount uses an RGB value 
as color difference information; a value "1" is set in 

10 "Mode" when the image feature amount uses a YUV value, 
thus indicating the type of image feature amount. A 
field 3 04 stores " TileFormat " indicating the formats of 
images stored in the image data area 2 03. "TileFormat" 
stores a value "0" for an image compressed by JPEG; "1" 

15 for BMP (bitmap); and "2" for FlashPix™. 

Fields 305 and 306 respectively store "TileWidth" 
and "TileHeight" which respectively indicate the width 
and height of each image stored in the image data area 
203. Note that these values are expressed by the number 

20 of pixels. A field 307 stores " SectionMode" indicating 
the screen division method upon computing a feature 
amount. In this example, a value "0" is set when an 
image is divided into six regions, as will be described 
later, or a value " -1" is set when an image is not 

2 5 divided. 
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A field 308 stores a pointer " PointerToTile" 
indicating the start address of the image data area 202. 
For example, when the image data area 202 follows the 
image information area 201 without any gap, since the 
5 size of the image information area 2 01 is 64 bytes in 
this example, the value of the image data area pointer 
308 is 64. 

A field 3 09 stores a pointer " PointerToData" 
indicating the start address of the image feature amount 
10 data area 203. A field 310 stores a pointer 
gg " PointerToIndex" indicating the start address of the 

Lj index area 204. A field 311 is an auxiliary field, 

UP 

"~ !! which is assured to have a size of N x 4 bytes. 

?1 Note that the order of information in the 

jfj* 15 aforementioned fields 301 to 311 is not limited to this 

W example. 

Fig. 4 shows details of the data configuration in 
the feature amount data area 2 03 in Fig. 2. Reference 
numerals 401 and 402 denote feature amounts computed 
20 from the first and second images among a plurality of 
images. Note that the computation method of image 
feature amounts will be explained later. In Fig. 4, a 
total of 18 data R(0, 0) to B(2, 1) express feature 
amounts of one image. R(0, 0), G(0, 0), and 33(0, 0) 
2 5 indicate the R, G, and B average values of the upper 
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left corner region (to be described later using Fig. 10) 
of six-divided regions of one image. 

Note that " NA " in Fig. 4 indicates an 
insignificant value. In this embodiment, each of the R, 
5 G, and B average values is expressed by 1 byte, and 4 
bytes are used as one unit. As another method, NA 
fields may be removed, and only R, G, and B values may 
be stored. 

Fig. 5 shows details of the data configuration in 

10 the image data area 2 02 shown in Fig. 2. Fig. 5 shows a 
case wherein JPEG is used as an image compression scheme. 
In this case, the field 304 (TileFormat) that stores 
information indicating the image format in the image 
information area 2 01 stores information indicating JPEG. 

15 Referring to Fig. 5, reference numeral 501 denotes 

JPEG-compressed data of the first image among image 
data; and 5 02, JPEG-compressed data of the second image. 
In Fig. 5, SOI, APP0 , DHT, DQT, SOF0, SOS, and EOI are 
partition symbols called markers. SOI indicates the 

2 0 start of JPEG data; EOI, the end of data; APP0 , an area 
that an application can arbitrarily use; DHT, a Huffman 
table; DQT, a quantization table; SOF0 , baseline JPEG 
compression; and SOS, Huffman codes. Compressed data of 
one image corresponds to a portion bounded by SOI and 

25 EOI. Refer to ITU-T WHITE BOOK digital still image 

compression coding recommendations (The ITU Association 
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of Japan, Inc.) for JPEG. In the example in Fig. 5, 
JPEG data is used, but other image file formats such as 
BMP, FlashPix™, and the like may be used. 

Fig. 6 shows details of the data configuration in 
5 the index area 2 04 in Fig. 2. Referring to Fig. 6, 
reference numeral 5101 denotes a field for storing 
reference information to information that pertains to 
the first image. Likewise, the area 2 04 sequentially 
stores reference information to information that 

10 pertains to each of N image data in fields 5102, 
5103,..., as shown in Fig. 6. 

A processing sequence for writing data on the hard 
disk 106 or floppy disk 107 in the format with the 
aforementioned configuration to create an image file 

15 will be explained below. Note that a case will be 
explained below wherein the version number as the 
revision number of this image format is 3, the number of 
images is 100, the feature amount mode is RGB, the image 
format is JPEG, the image size is width x height = 384 x 

2 0 2 56, and feature amount extraction is done in the 
division mode (six-division) . 

Fig. 7 is a flow chart showing an outline of an 
image file generation process in the first embodiment. 
Referring to Fig. 7, header data such as the version 

2 5 number, the number of images, mode, and the like are 

written in the image information area 201 in step S601. 
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In step S602, each image data is read, undergoes 
processes such as feature amount extraction and the like, 
and is written in the image data area 202. In this 
embodiment, image data is compressed by JPEG, but the 
5 presence/absence of compression or the image data format 
is not limited to such specific example. In step S603, 
image feature amount data and index data obtained in 
step S602 are respectively written in the feature amount 
O data area 203 and index data area 204. In step S604, 

m 10 information which remains unwritten in step S601 is 

kg additionally written in the image information area 2 01 

Li upon receiving the processing result in step S602 . 

The processes shown in Fig. 7 will be described in 
more detail below. 
15 {Description of Step S601} 
§3 Fig. 8 is a flow chart for explaining the header 

data write process in step S601 shown in Fig. 7 in 
detail. Note that the image file in which data is to be 
written is already opened upon executing this process. 
20 In step S701, a value indicating "Version" ("3" in 

this embodiment) is written in the field 3 01 in the 
image information area 201. In step S702, the number of 
images ("100" in this embodiment) to be stored in the 
image file is written in the field 302 (Images) . In 
25 step S703, "0" (RGB) or "1" (YUV) is written as the mode 
of image feature amounts in the field 3 03 (Mode) (since 
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this example uses RGB, a value "0" is written). In step 

5704, a value 0 (indicating JPEG) is written in the 
image format field 3 04 (TileFormat) in the image data 
area 203. Note that "tile" in the flow chart indicates 

5 each image to be stored in the image data area. In step 

5705, the image width (TileWidth) ("384" in this 
embodiment) and image height (TileHeight) ("256" in this 
embodiment) are respectively written in the fields 3 05 

O and 3 06. In step S7 06, a value indicating the division 

gfi 10 mode upon computing image feature amounts is written in 

j§g the field 3 07 ( SectionMode) . In this embodiment, "-1" 

Ls is stored for the non-division mode; "0" for the 

* ,a 6-division mode; and "1" for the 8-division mode. Since 

rl this example uses the" 6-division mode, a value "0" is 

15 written in the field 307. 
y In step S707, an area for temporarily storing 

feature amount data stored in the image file is assured 
on the memory (RAM 105) . In this embodiment, since 
feature amount data that uses a 24-byte area per image 
2 0 is stored, the area to be assured on the memory is 2 4 
bytes x the number of images. Note that the number of 
images is "Images" set in the field 3 02 in step S7 02. 
The area assured in this step is handled as a 
two-dimensional matrix D[Images] [24] , i.e., Images x 24 
25 (to be referred to as a matrix D hereinafter) . 
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In step S7 08, an area for temporarily storing 
reference information of each image is assured on the 
memory. In this embodiment, since a 4-byte field is 
used per image, the area to be assured on the memory is 
5 4 bytes x the number of images. Note that the number of 
images is "Images" set in the field 3 02 in step S7 02. 
The area assured in this step is handled as a 
two-dimensional matrix INDX [Images] [4 ] , i.e., Images x 4 
(to be referred to as a matrix INDX hereinafter) . 

10 In step S709, the start address pointer of the 

image data area 2 02 is written in the field 3 08 
( PointerToTile) . In this embodiment, since the image 
information area 201 consists of 64 bytes and the image 
- data area is allocated immediately after the area 201, a 

15 value "64" is written. 

{Description of Step S602} 

Fig. 9 is a flow chart for explaining a detailed 
sequence of the process in step S602 in Fig. 7; 

In Fig. 9, each of a plurality of input image 

2 0 files is opened, and each image undergoes computation of 
an image feature amount and a compression process. 
Furthermore, since image data are continuously stored in 
the file, the compressed image data size of each image 
is computed, and is added to the start position of the 

25 image data area 202, thus computing the start position 

of each image. After that, the compressed image data is 
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written in the image data area 2 02 to complete the 
process for one input image, and the file is closed. 
This process is repeated for all input images. 

In step S801, the value indicating the total 
5 number of images (the value stored in the field 301 

(Images); 100 in this example) is set in a variable INUM. 
In step S802, a variable i is reset to zero. 

In step S803, an input file (i) is opened. In 
step S804, feature amounts are computed from the opened 

10 image. In this process, as will be described in detail 
later, the computed feature amounts consist of 18 
feature amount data, as described above using Fig. 4, 
but 2 4 feature amounts d[0] to d[23] including six "NA" 
data are computed. In step S805, feature amount data 

15 d[0] to d[23] obtained in step S804 are stored in 

elements d[i] [0] to D[i] [23] of the matrix D in the 
feature amount storage area assured in step S707. 

In step S806, the image opened in step S803 is 
compressed by JPEG. In step S807, the file name of the 

2 0 input file (i) of interest is written in INDX[i] [0] to 
INDX[i][3] as reference information. In step S808, 
compressed image data is written in the file, and the 
number of written bytes is added to ISIZE. In step S809, 
the input file (file (i)) opened in step S803 of this 

25 loop is closed. In step S810, i is incremented by 1. In 
step S811, i is compared with INUM . If i ^ INUM, the 
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flow returns to step S803 to start the process of the 
next input image. On the other hand, if i = INUM, since 
all INUM image files have been processed, this process 
ends . 

5 {Description of Step S804} 

Computation of image feature amounts in step S804 
described above will be explained. 

Fig. 10 shows screen division upon computing 
feature amounts in this embodiment. As shown in Fig. 10, 

10 the size of an image of interest is W pixels in the 
horizontal direction x H pixels in the vertical 
direction. In this embodiment, this image is divided 
into three regions in the horizontal direction x two 
regions in the vertical direction, i.e., a total of six 

15 regions, which are defined as region (0, 0), region (1, 
0) , . . . , region (2, 1) in turn from the upper left one. 
In this embodiment, the R, G, and B average values of 
these regions are computed, and 18 numerical values are 
used as feature amounts of the image of interest. 

20 Fig. 11 is a flow chart for explaining the feature 

amount computation process according to this embodiment. 
A variable k is reset to a value "0" in step S1201, a 
variable j is reset to a value "0" in step S1202, and a 
variable i is reset to a value "0" in step S1203. 

2 5 In step S12 04, the R average value of region (i, 

j) is substituted in the k-th element d[k] of matrix d. 
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Also, the G and B average values are respectively 
substituted in d[k+l] and d[k+2] . Note that the 
computation method of the R, G, and B average values 
will be described later using the flow chart in Fig. 12. 
5 In step S1205, k is incremented by "3". In step 

S1206, i is incremented by "1". In step S1207, i is 
compared with a value "2". If i > 2, the flow advances 
to step S1208; otherwise, the flow returns to step S1204. 
p If i > 2, since it indicates that the process for 

^ 10 the divided row of interest is complete, the control 

IiS enters the next divided row. Hence, j is incremented by 

"1" in step S1208. In step S1209, j is compared with a 
^' value "1". If j > 1, since it indicates that the 

f*t process for the second divided row is complete, i.e., 

^ 15 the process for the overall screen is complete, this 

O process ends. Otherwise, the flow returns to step S1203 

to execute the process for a new divided row. 

Upon completion of the aforementioned process, the 
image feature amounts of an image are stored in matrix 
2 0 d[] having 18 elements. 

Note that the image is divided into six 
rectangular regions having equal areas to compute 
feature amounts. However, the shape of each divided 
region is not limited to the rectangular shape but may 
2 5 be a more complicated shape, and the number of divided 
regions may be increased/decreased. As can be easily 
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understood from the above description, when the number 
of divided regions is increased/decreased, the number of 
elements as the feature amounts is not 18 but 
increases/decreases accordingly. 
5 The computation method of the R, G, and B average 

values will be described in more detail below. Fig. 12 
is a flow chart for explaining the computation method of 
the R, G, and B average values of each region. Note 
that image data is stored in three sequences R(X, Y) , 

10 G(X, Y) , and B(X, Y) . In this case, 0 < X < W and 0 < Y 
< H, and the upper left corner of an image is set as an 
origin ( 0 , 0 ) . 

In the process shown in Fig. 12, the average 
density values of a partial region defined by X 0 < X < X 1 

15 and Y 0 < Y < Y 1 are computed, R, G, and B average values 
are substituted in variables DR, DG, and DB, and the 
variables DR, DG, and DB are returned. 

In step S804 and the process shown in Fig. 11, 
since a region corresponding to region (i, j) 

20 corresponds to: 

X 0 = W X i/3, X 1 = W x (i + l)/3 
Y 0 = H X j/2, Y 1 = H X (j + l)/2 
constants X 0 , X lf Y 0 , and Y x are initialized, as described 
above, and the flow chart shown in Fig. 12 is then 

2 5 executed. 
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In step S1301, variables DR, DG, and DB are reset 
to a value "0". In step S1302, a variable Y is reset to 
Y 0 mentioned above. Likewise, a variable X is reset to 
X 0 mentioned above in step S1303. 



G(X, Y) is added to DG, and B(X, Y) is added to DB. In 
step S1305, the variable X is incremented by a value "1" . 
In step S13 06, the variable X is compared with X x . If X 
= X 1# the flow advances to step S13 07; otherwise, the 

10 flow returns to step S1304. In step S1307, the variable 
Y is incremented by a value "1". In step S1308, the 
variable Y is compared with Y 1 . If Y = Y 1# - the flow 
advances to step S1309; otherwise, the flow returns to 
step S1303. With the processes in steps S1303 to S1308 

15 described above, the total values of R values, G values, 
and B values within the region specified by X 0 , x 1# Y 0/ 
and Y-l are respectively stored in DR, DG, and DB. 

In step S1309, the variables DR, DG, and DB are 
respectively divided by (X x - X 0 ) x (Y x - Y 0 ) . This 

2 0 process indicates that the values stored in the 

variables are divided by the number of pixels in the 
region, i.e., the average values are computed. 
Therefore, with the process in step S13 09, the contents 
of DR, DG, and DB are average density values obtained by 

2 5 dividing the sum totals of the pixel density values in 
the region by the number of pixels. 



5 



In step S1304, R(X, Y) is added to DR. Likewise, 
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{Description of Step S603} 

The data write process in the feature amount data 
area 203 and index area 204 in step S603 in Fig. 7 will 
be described below. 
5 Index data to be written in the index area 204 is 

generated in step S807 in Fig. 9 described above. 
Fig. 13 is a flow chart for explaining the storage 
process of reference information (index data) in step 
q S807 in Fig. 9 in detail. 

in 10 In step S1401, for example, if the full-path file 

fin name of an original file (input file) is 

Lj C:¥tmp¥C12345. jpg, a character string ,, C12345" is 

extracted from this file name. 

In step S1402, "C12345" is separated into alphabet 
^ 15 part "C" and numerical value part "12345", and the 

O alphabet part is converted into an ASCII code which is 

substituted in CINDX. In this example, a value "0x43" 
is stored. The numerical value part is converted into 
an integer without any sign, and lower 24 bits are 
20 substituted in NINDX. 

In step S1403, a value obtained by shifting CINDX 
to the left by 24 bits, and then adding the value NINDX 
thereto (a total of 4 bytes = 32 bits) is substituted in 
the memory area INDX[i] [0] to INDX[i][3] assured in step 
25 S708. 
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Fig. 14 is a flow chart for explaining the data 
write process in the feature amount area and index area 
in step S603 in Fig. 7. In this process, feature amount 
data and index data are written. 
5 Upon completion of step S602, the access pointer 

to the file is located at the trailing end of the image 
data area. Hence, the feature amount data D[ Images] [24] 
acquired in step S805 are written in an output file in 
step S1501. As a result, feature amount data are stored 

10 in the area 2 03 in Fig. 2 to follow the image data area. 
In step S1502, index data INDX [ Images ][ 4 ] acquired in 
step S1403 are written in the output file. As a result, 
the index area 2 04 is formed to continue from the 
trailing end of the feature amount data area 203. 

15 {Description of Step S604} 

Fig. 15 is a flow chart for explaining the image 
information additional write process in step S604 in 
Fig. 7. In this process, data are written in unwritten 
fields in the image information area 201. In step S1601, 

20 PointerToTile + ISIZE is written in the field 309 

( PointerToData) . Note that the values PointerToTile and 
ISIZE are respectively set in steps S709 and S808. 
Subsequently, in step S1602 a value PointerToData + 4 x 
Images is written in the field 310 ( PointerToINDX) . 

2 5 As described above, according to the first 

embodiment, since means for writing, in a single file, 
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header information that describes information required 
for reading out and displaying images, an image data 
area that continuously stores all images, a feature 
amount data area that stores feature amounts of all the 
5 images, and an index area that stores information which 
pertains to each image, e.g., the location of data with 
higher resolution than that image, an image with higher 
resolution than those in a database can be referred to, 
and high-resolution print can be done as needed. 

10 In the above embodiment, the file name is recorded 

in the index area 2 04 while being separated into 1-byte 
symbol part (alphabet) and 3-byte numerical value part. 
However, this is merely an example for limiting the size 
of the index area 2 04 to 4 bytes, and the file name may 

15 be stored in other description formats. Also, a URL for 
accessing a server that stores high-resolution images 
via the Internet may be directly recorded as an ASCII 
code. In this manner, the URL can be directly 
substituted, and substitution in the index area or 

20 reference from the index area can be easily made. In 

this case, each index area must be expanded to, e.g., 64 
bytes . 

In the above embodiment, information to be written 
in the index area is not limited to still image 
2 5 information. For example, an arbitrary image frame of 

an AVI file may be designated. In this case, image data 
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corresponding to image frames extracted from one or a 
plurality of AVI files are stored in the image data are 
202, and the AVI file names and frame designation 
information corresponding to the stored images are 
5 stored in the index area 204. In this manner, an AVI 
file can be searched using a representative frame of a 
continuous scene of a moving image, or a given scene of 
a moving image file can be designated and played back 
based on the search result. 

10 Note that the present invention may be applied to 

either a system constituted by a plurality of devices 
(e.g., a host computer, an interface device, a reader, a 
printer, and the like) , or an apparatus consisting of a 
single equipment (e.g., a copying machine, a facsimile 

15 apparatus, or the like). 

The objects of the present invention are also 
achieved by supplying a storage medium, which records a 
program code of a software program that can implement 
the functions of the above-mentioned embodiments to the 

20 system or apparatus, and reading out and executing the 
program code stored in the storage medium by a computer 
(or a CPU or MPU) of the system or apparatus. 

In this case, the program code itself read out 
from the storage medium implements the functions of the 

2 5 above-mentioned embodiments, and the storage medium 
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which stores the program code constitutes the present 
invention . 

As the storage medium for supplying the program 
code, for example, a floppy disk, hard disk, optical 
5 disk, magneto-optical disk, CD-ROM, CD-R, magnetic tape, 
nonvolatile memory card, ROM, and the like may be used. 

The functions of the above-mentioned embodiments 
may be implemented not only by executing the readout 
program code by the computer but also by some or all of 
10 actual processing operations executed by an OS 

(operating system) running on the computer on the basis 
of an instruction of the program code. 

Furthermore, the functions of the above-mentioned 
embodiments may be implemented by some or all of actual 
15 processing operations executed by a CPU or the like 
arranged in a function extension board or a function 
extension unit, which is inserted in or connected to the 
computer, after the program code read out from the 
storage medium is written in a memory of the extension 
2 0 board or unit. 

To restate, since a plurality of image data are 
stored in a single file, high-speed access to image data 
and easy management of image data are allowed, and 
information that pertains to each image data can be 
2 5 acquired from a source outside the image file, thus 
providing various services. 
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As many apparently widely different embodiments of 
the present invention can be made without departing from 
the spirit and scope thereof, it is to be understood 
that the invention is not limited to the specific 
embodiments thereof except as defined in the appended 
claims . 



